REINREF - Descriptors - Supplementary list No. 2

Cover vol.2, no.2 October 2005

Supplementary Reading List , Version 1 1 Books and monographs

2 List of participants

These are the proceedings of the workshop ”HadAtom99”, held at the Institut für Theoretische Physik, Universität Bern, October 14 15, 1999. The main topics discussed at the workshop were the physics of hadronic atoms and in this context recent results from Chiral Perturbation Theory. Included here are the program, the list of participants and a short contribution from the speakers.

Vol. 8, No. 2 , 2019

No More Pesky Learning Rates: Supplementary Material

If we do gradient descent with η * (t), then almost surely, the algorithm converges (for the quadratic model). To prove that, we follow classical techniques based on Lyapunov stability theory (Bucy, 1965). Notice that the expected loss follows E J θ (t+1) | θ (t) = 1 2 h · E (1 − η * h)(θ (t) − θ *) + η * hσξ 2 + σ 2 = 1 2 h (1 − η * h) 2 (θ (t) − θ *) 2 + (η *) 2 h 2 σ 2 + σ 2 = 1 2 h σ 2 (θ (...